Representations of Sparse Distributed Networks: A Locality-Sensitive Approach

نویسندگان

  • Haim Kaplan
  • Shay Solomon
چکیده

In 1999, Brodal and Fagerberg (BF) gave an algorithm for maintaining a low outdegree orientation of a dynamic uniformly sparse graph. Specifically, for a dynamic graph on n-vertices, with arboricity bounded by α at all times, the BF algorithm supports edge updates in O(log n) amortized update time, while keeping the maximum outdegree in the graph bounded by O(α). Such an orientation provides a basic data structure for uniformly sparse graphs, which found applications to several dynamic graph algorithms, including adjacency queries and labeling schemes, maximal and approximate matching, approximate vertex cover, forest decomposition, and distance oracles. A significant weakness of the BF algorithm is the possible temporary blowup of the maximum outdegree, following edge insertions. Although BF eventually reduces all outdegrees to O(α), some vertices may reach an outdegree of Ω(n) during the process, hence local memory usage at the vertices, which is an important quality measure in distributed systems, cannot be bounded. We show how to modify the BF algorithm to guarantee that the outdegrees of all vertices are bounded by O(α) at all times, without hurting any of its other properties, and present an efficient distributed implementation of the modified algorithm. This provides the first representation of distributed networks in which the local memory usage at all vertices is bounded by the arboricity (which is essentially the average degree of the densest subgraph) rather than the maximum degree. For settings where there is no strict limitation on the local memory, one may take the temporary outdegree blowup to the extreme and allow a permanent outdegree blowup. This allows us to address the second significant weakness of the BF algorithm – its inherently global nature: An insertion of an edge (u, v) may trigger changes in the orientations of edges that are arbitrarily far away from u and v. Such a non-local scheme may be prohibitively expensive in various practical applications. We suggest an alternative local scheme, which does not guarantee any outdegree bound on the vertices, yet is just as efficient as the BF scheme for some of the aforementioned applications. For example, we obtain a local dynamic algorithm for maintaining a maximal matching with sub-logarithmic update time in uniformly sparse networks, providing an exponential improvement over the state-of-the-art in this context. We also present a distributed implementation of this scheme and some of its applications. ∗School of Computer Science, Tel Aviv University, Tel Aviv 69978, Israel. E-mail: [email protected]. †IBM Research. E-mail: [email protected]. ar X iv :1 80 2. 09 51 5v 1 [ cs .D S] 2 6 Fe b 20 18

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Strongly-Bounded Sparse Decompositions of Minor Free Graphs

As networks grow large and complex, a key approach in managing information and constructing algorithms is to decompose the network into locality-preserving clusters. Then, information and/or management can be divided between the clusters, such that every node is responsible only for clusters for which it belongs. Such decompositions into locality sensitive clusters have become key tools in netw...

متن کامل

Sparse Partitions

This abstract presents a collection of clustering and decomposition techniques enabling the construction of sparse and locality preserving representations for arbitrary networks. These new clustering techniques have already found several powerful applications in the area of distributed network algorithms. Two of these applications are described in this abstract, namely, routing with polynomial ...

متن کامل

An Audio and Music Similarity and Retrieval System Based on Sparse Feature Representations

In this paper, we present an audio and music similarity and retrieval(AMSR) system, which employed sparse feature representations. Our system first extracts Melscaled spectrum from audio snippet. Next, sparse restricted Boltzmann machine (RBM) is trained for feature representation. In order to enhance computational efficiency in retrieval phase, we employed locality sensitive hashing (LSH) meth...

متن کامل

Learning Sparse Representations of High Dimensional Data on Large Scale Dictionaries

Learning sparse representations on data adaptive dictionaries is a state-of-the-art method for modeling data. But when the dictionary is large and the data dimension is high, it is a computationally challenging problem. We explore three aspects of the problem. First, we derive new, greatly improved screening tests that quickly identify codewords that are guaranteed to have zero weights. Second,...

متن کامل

Image Classification via Sparse Representation and Subspace Alignment

Image representation is a crucial problem in image processing where there exist many low-level representations of image, i.e., SIFT, HOG and so on. But there is a missing link across low-level and high-level semantic representations. In fact, traditional machine learning approaches, e.g., non-negative matrix factorization, sparse representation and principle component analysis are employed to d...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1802.09515  شماره 

صفحات  -

تاریخ انتشار 2018